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ABSIRftCT 



One of the roost iinfortant steps in conducting a mail census of the United 
States is the developroent of an accurate, ip-to-date list of lesidaitial 
mailing addresses. However , teaching census employees to read and properly 
ijpdate census mE4)s to develop this address list has been a oontiniung 
problem. A significant nuriber of census eonployees, even cifter training 
sessions, use waps incorrectly yAddh leads to inefficiencies in field work and 
geographic problems that eventually must be corrected. 

Htds p^per describes a new approach for training census enunerators to use 
census maps. Biis c^roadi, called the "geogrs^Mc gam^oard," is a training 
simulation consisting of three ocnpOTents: an imaginary, graphiccilly-depicted 
ccninunilg^ (Abbotsville, Oklahona), a caisus m^ that corresponds to the census 
geogra|*iy of Abbotsville, and blank pages for listing addresses. 

Ihe unique portion of this training simulation is Abbotsville - an imaginary 
rural ccmmmity vMch was purposely created to reflect a wide range of living 
arrangements and geogre^hic features. Qtplqyees learn to perform their job 
and use census maps by canvassing and listing the mailing addresses of 
residences in Abbotsville. As th^ do this, th^' correct and update census 
gecgrapity shewn on an acocnpanying map of Abbotsville. For example, 
numerators add and delete roads, correct road names, and m^ spot the 
locations of residences. 

Hiis training c^pro'- was used for the first time in 1987 to develop a list 
of mailing addresr ^ x Missouri for the 1988 census dress rehearsal. Ohis 
paper will rqport the results of observaticai reports and the use of an 
end-of-course test designed to measure the minin.jm skills needed by a census 
enunerator to perform successfully in this job. 



USE OF THE GEOGRAPHIC GAMEBOARD FOR MAP-USE TRAINING 



1 . BACKGROUND 

Although approaches. for taking the decennial census of the United States have 
changed drastically over the years, census maps and. specifically, correct 
use of those maps remains an Integral part of the census. 

Both In preparation for and during the 1990 census, census workers, called 
enumerators, will use maps to develop address lists In n-iny areas of the 
United States, to assign living quarters to correct census geography, to check 
the completeness of address lists purchased from vendors In urban areas, and 
to locate households that faMed to return a census questionnaire In the 



Obvlous.y, the ability to use maps Is a critical job skill for many census 
takers, but unlike general literacy. It appears the ability to read a map Is 
lacking in a large part of our population. For example, results from a recent 
survey of the literacy skills of young adults ^ Indicated that only 6 
percent of Americans In their early 20s read below the fourth-grade level and 
only 5 percent could not perform "routine and uncomplicated tasks," such as 
reading a short sports story In a newspaper or completing a job application. 
However, 57 percent of young adults could not decipher a street map. 

The results of this survey unfortunately have been confirmed by our own 
experiences with census workers using maps. Even after training sessions 
lasting two days, some census enumerators experience problems such as becoming 
disoriented, listing mailing addresses In the wrong census geography, 
Improperly using map scales and spotting the locations of structures on maps, 
getting lost, and Incorrectly updating census maps (e.g., adding a road In the 
wrong place). In addition to problems using census maps, we also discovered 
that some enumerators left training with a gross misunderstanding of 
procedures. For example, all structures in a given geographic area might have 
been spotted on a map. rather than just living quarters (places where people 
live or could live). 

These problems, of course, are illustrative, and they do not mean that the 
majority of work performed by census enumerators is shoddy or incompetent. 
Nor do they imply that poorly skilled or trained workers are the source of all 
the problems. Particularly in the 1980 census, poor map quality was also a 
contributing factor. Nevertheless, the fact that such problems occur means 
that the Census Bureau must implement extensive quality control procedures, 
which raise the cost of taking the census. Our goal, therefore, has been to 
search for ways to Improve the performance of our field workers. This search 
has focused on three areis: 

0 Improving the map-preparation process and the "useability" of the map 
product. 

0 Improving the selection of workers. 



0 Improving training. 
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paper's primpry Interest Is training, I will not discuss the major 
efforts that have been undertaken since 1980 to Improve the quality of map 
products. Instead, interested readers can refer to a variety of sources 

(specifically the USER system) that are available 

Another subject of interest, but one which I also will not spend much time on 
Is selection. Obviously, If we could select persons who already knew hoJTto 
w^t* T greatly simplified anS thJrJ fM Je 

Immediate benefits for field work. Unfortunately, besides the apparent short 
hcSh S!.°!K*''f"""\' "^^^ map-reading skills, thJ selectlon test p?e«ntly 
used by the Census Bureau Is unable to discriminate between those workers who 
can and cannot use maps. Instead, It was designed to be a general selecllJn 
device and, therefore. Is used to screen applicants for a wide variety of 
noSuU? .I'I-'k'^""^"^ and office work, data keying, certain enulierator 
positions, etc.) where map reading Is absent or relatively unimportant. 

UM^Jn.""^*'''?''*' alternatives of either developing a separate selection 
test for assessing map-reading skills or lengthening the existing test to 
provide better discrimination, but neither of these options has been embraced 
^JZ ^'^'f"" °^ logistical comSlexlty of conSuc?1ng"he 

census, the large numbers of people that must be scHened and hired, as well 
as the Inexperience which pervades all levels of the work force, our field 

TS!???fr.?%^n«;?^"!J.*^** !" additional selection test would add unwarranted 
logistical complexities and costs, therefore, they have resisted It 
Moreover, they report that In some areas of the country, there art inadequate 
numbers of applicants so that use of such a test would be meaningless for 
screening purposes. Using similar arguments, they have also resisted 
lengthening the ex1st<ng test because many believe that It Is already too long 
and complex. In fact, the trend since 1980 has been to shorten the length of 
the test significantly (by about 50 percent). 

Instead of Improving selection methods, the approach we are currently pursuing 
is to Improve training. There are two features to this approach. First we 
are examining ways to Improve our delivery of training. And, second, we'have 
implemented end-of -course tests designed to measure how much was learned 
during training (conceptual test) and how well the enumerator actually 
performed on the job Immediately after training. The Intent of these 
evaluations Is to ensure that a person who leaves training Is able to do the 
job correctly before being allowed to work. In essence, rather than use a 
specialized selection test, the screening process Is the training Itself. I 
will present a detailed description of the training and evaluation measures In 
subsequent sections of this paper. 

2. THE ENUMERATOR'S JOB 

It Is difficult. If not Impossible, In a paper such as this to describe how 
map-use training Is conducted because It varies widely depending on the census 
Job. However, for purposes of discussion, I will focus on one of the larger 
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and more Important jobs that requires the use of census maps - the orelist 
enumerator. *^ H'ensi 

Since over 90 percent of the American public will be enumerated by mall In 

°^ "^'^ ^""^^^"^ ^**P5 the development of an accurate 
up-to-date ma ling list of all residential addresses (occupied or vacSnt) 
After evaluations conducted In 1984. the Census Bureau decided that the m^st 

^^'^^'^^^^^ l^^t was to update mailing 1? Js ^SrcS^sed 

iJil !: H^H "/k"*" ''"^ ^° •'•^^'^l^P ^"-^ l^^t from scratch In areas 
where we did not have the necessary resources to assign geographic codes by 
computer to vendor addresses. We estimate that developing our own list In 
rura areas will require listing the mailing addresses of about 40 m llloS 
housing units (places where people live or could live). The prellst 
enumerator has the responsibility for developing this list. 

I^.IJ'^VJ' ^°M*"lf Is straightforward. Working In a limited geographic 
?^!J;n! enumerator systematically travels throughout the area 

nfJn^tJJ! °^ residential strictures, since limited 

rlnTfi u ! * """^^ Interview with a respondent Is 

iI^VJI a' "'^r'^r^^'*!*". as you might expect, there are complicating factors. 
In the decennial census, the Census Bureau Is responsible fSr counting both 
J5r.wJj!!;!lH*"*' stock. Although counting people Is relatively 

straightforward, counting the places where people live requires arbitrary 

tS; BlJIJn?c*5!J^i;?5J J''?^?** enumerators. One of the most Important Is 
the Bureau's definition of living quarters. Living quarters are defined as 
places where people live or could live and Include two basic types: housing 
units and special places. ••uusing 

a 52I!nllSS.;"^i I^K?5"*I^^ apartment, a single-family house, a condominium, 
a townhouse, a mobile home, or a cooperative. But. It could also be a tent a 
single room, or a group of rooms In a building If It meets two criteria. ' 
Specifically, people must live and eat separately from others In the 
structure, and they must have direct access to their living quarters. One 
source of confusion between the U.S. Postal Service and the Census Bureau Is 
that In some (often rural) areas, one mall delivery point (mailbox, P.O. Box. 
etc.) might service more than one distinct housing unit as defined by the 
Census Bureau. It Is the responsibility of the prellst enumerator to Identify 
all possible housing units so that a separate questionnaire can be delivered 
to each household with separate living arrangements. 

Special places, on the other hand, are types of living arrangements that 
require different census-taking procedures. For example, prisons, motels, 
hospitals, halfway houses, colleges, military bases, hotels, and convalescent 
homes are all examples of special places. Although a prellst enumerator 
usually has little to do with such places (they are handled by a different 
census taker), they must be able to recognize them, verify their existence, 
and add them to our mailing list If necessary. 
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.3. PAST TRAINING FOR PRELIST ENUMERATORS 

In the past (as well as now), census enumerators were trained to do their job 
using a highly structured, comprehensive training guldt*. This aiulde covered 
the rules of canvassing, explained how to read and use census maps, presented 
the definitions of living quarters, and described some- of the unusual 
situations that night occur. Whenever possible, such descriptions were 
supplemented by more active, skill-based training during which the enumerator 
actually performed the steps of the job, such as listing addresses In a 
address book, spotting tl.e locations of living quarters on a map, determining 
the number of housing units In different types of situations, and making 
corrections to census maps. 

Based on our analyses of this training, we believed there were four basic 
faults with It. First, It did not present the job as an Integrated whole. 
Enumerators learned how to conduct the brief Interview with a respondent, how 
to canvass, how to map spot, how to apply the housing unit definition, etc., 
but they learned these skills separately In different segments of the 
training. There was an attempt to "pull It all together" In a wrap-up 
exercise at the end of training, but because training time was limited, this 
exercise was quite short (about an hour). 

Second, despite the attempt to use an active approach to learning, there was 
still a lot of lecture. But, perhaps more Importantly, the training lasted 
two complete, consecutive days. For example, a typical training day might 
start at 9:00 a.m. and end at 4:00 or 5:00 p.m. The result was that fatigue 
became an Impediment to learning In the afternoon. Moreover, because of the 
varied and different procedures being covered, some trainees were overwhelmed 
by the amount of material covered. 

A third problem was that, because an end-of-course test was not a part of the 
training, we did not really know what the trainees retained when they left 
training. 

A fourth problem was that the training sometimes presented an unrealistic 
picture of what the job would be like. Maps used In the training were largely 
error free, most of the living arrangements were straightforward, etc. 
Unfortunately, for many enumerators, the reality of the job was quite 
different when they started working. 



4. POSSIBLE TRAINING ALTERNATIVES 

A major problem-faced In training prellst enumerators Is bridging the gap 
between the classroom and the problems of the "real" world. Probably one of 
the best ways to train people to do this job would be to pair them with an 
expert and then have the expert train them on-the-job. With this approach, 
people would learn how to use a map and canvass by actually canvassing. 
Accordingly, they would deal firsthand with map errors or discrepancies, 
problems with map orientation, use of the map scale, and spotting the 
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IJSfit ♦kJ! "^'^ 'fPortantly, since they were accompanied by an 

SSJnhK**"? r"?^"" inmedlate feedback about their perfom^nce. This 

* °^ ""^o-^tunately. there's an Important Ingred ent 

missing in a census - an adequate number of experts. •■'sreuiem 

Census operations, such as developing a list of mailing addresses (prellst) 
often occur at the same time In different areas across the country Thir 
wStlL'f 'r?Jj^"«K''l!" concurrently In lUeJIllJ'hXirof 

JS^;r;jl'f-I^r°"?^ ^" "P'^'^^^ ^" canvassini and use of maps. 

SafSers fn.jL^H *?k^°.'''^^"JT considering their use as on-the-jS*^ * 
uMrS H'h i!^"5*k^^'' "expert- becomes a highly structured training guide 

rs;5?e'?hJ^j;:?n"jg''?e;sj;;:"^ ^^^^^ ^-^^ ^^^^^ - - 

Another alternative the Bureau has considered Is the use of videobased 
JJJ S US AftT^'^K ;[:J";'^''«ed feeling of reality to the classroom 
training. Although this Is an appealing approach. It has two major 
nrJ!!J*5i'H^ 1"? I?9jst1cal complexity, since most training sessions 
occur In dispersed training sites with typically 8 to 12 people. It would be 
expensive to rent and distribute the necessary equipment. Hireiver ?Sere Is 
always a concern about theft and correct use of the equipment by 1n«pe?'enced 
trainers. Nevertheless, this approach re..«1ns an appealing option S nirSSe 
we have made great progress on at this time. 

IIaILI.^ I!*!* been able to solve the logistical and cost problems of 
videobased training, plus we lack an adequate nuirber of experts to train 
people on the job. what alternatives are there other than traditional 
classroom approaches to the training? One possibility the Census Bureau Is 

a training simulation which relies on a specially designed 
training aid. This approach Is called the "geographic gameboard." 



5. THE GEOGRAPHIC GAHEBOARO 

iI..?fJ"K"*"°J 5"^"^ trainees into the real world, then the next best thing 
?Mc h5% ! 5"^?^ the real wor-.d into the classroom. We have attempted to do 
this by developing a training simulation which consists of three parts: 

1. An imaginary, rural community, called Abbotsville, which Is 
represented graphically (dimensions: 31" X 21"). See 
Figure 1 for an illustration of one small part of 
Abbotsville. 

2. A census map which corresponds to an enumerator assignment area 
cov«r1ng most of Abbotsville. See Figure 2 for an 
illustration of the corresponding oart of Figure 1. 

3. Blank pages which are used to list mailing addresses. See 
Attachment A. 
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We decided to creatf a rural cowmunlty, Abbotsvllle, for use In the simulation 
because that's the type of conwunlty w^ere most of our map reading problems 
occur. The living arrangements represented on Abbotsvllle and the 
accompanying geography were purposely designed to reflect situations which we 
know have caused problems for enumerators In previous census work. The 
Important point to remember Is that for training purposes, Abbotsvllle 
represents "reality." It was designed to present Information that an 
enumerator would be able to obtain by either walking or driving around the 
area. Therefore, structures are represented. In most cases road names are 
available, and local landmarks (churches, schools, etc.) are present. In 
addition to cownon geographic features (roads, lakes, rivers, railroads, 
etc.), we Included the following types of situations which have caused 
problems for enumerators In the past: 

0 Roads (e.g., new housing developments, rural roads) exist In 
Abbotsvllle but are not shown on the census map. 

0 Roads are shown on the census map that do not exist In 
Abbotsvllle. 

0 Roads are unnamed on the census map and either named or 
unnamed In Abbotsvllle. 

0 Geographic boundaries for the enumerator assignment area 
Include both visible (e.g., road features) and Invisible 
boundaries (e.g., political boundaries). 

0 Standard, as well as Irregularly shaped blocks, are present 1n 
Abbotsvllle and are also shown on the census map. 

0 Less common map symbology, such as street extensions, are 
shown on the census map. 

0 Names of roads differ between Abbotsvllle and the census map. 

0 Changes in zip code areas occur in the enumerator's assignment 
area. 

In addition to representing geographic situations which we know have caused 
problems, we also represented living arrangements on Abbotsvllle that have led 
to enumerator errors in listing mailing addresses. For example, we included 
the following types of living arrangements: 

0 -Special places, such as convalescent homes and motels. 
0 A trailer/mobile home park. 

0 Living quarters in various stages of construction. 



0 Migrant worker and seasonal housing units. 



0 Vacant, abandoned, and cotidenmed housing units. 

0 Places that should not be listed such as high schools and day 
c«re centers. ' 

0 Different types of mall delivery, such as house number/street 
deTlvery* " common), rural route delivery, general 

0 Discrepancies between mailing addresses and location 

descriptions (e.g., a good location description might be 4500 
Route^2) "Wiling address might be Box 6, Rural 

Our objective In designing Abbotsvllle was to create an imaginary conwunitv 
that gave enumerators a realistic pictur-^ of the types of gJogrlSh^HSS 
procedural problems that they might encounter on the Job. In the training 

JSJotJS??ii°.*'li*'.'^ '"r! ""J "^^^^ ^'^ '^'^ representation (we do Sot c2ll 
JJS;! • *;/r°^** confusion with the accompanying ceisus map), but 

there is no reason that morn than one could not be used. In fact, for 

9^«nsus training reauiring maps, different representations 
would be required for maximum instructional effectiveness. It is also 

° ««Ph«1" that the training being <lescM bed was prepared for 
1987. Changes planned for the training will be described at the end of this 

5.1 DESIGN OF THE 6AMEBOAR0 (ABBOTSVILLE) TRAINING 

ilSs*[;I"IllH !;'J;?f*5''°^'''2\^' insists of a self-study (cor >'eted at home). 
Jl^! two and « half days of training, of which one half day .onsists of actual 
worK on the Job. The separate components are sequenced as follows: 

1. A brief (about one hour) self-study precedes classroom 
training. This is designed to present i general overview 
of the Job and to Introduce map produci;s and census vocabulary. 

2 A full day of classroom training (about 6-7 hours) which covers 
canvassing, map use, and application of the most conmon census 
procedures. 

3. A morning classroom session on the .secorid day which picks up where 
the previous day left off. Following this session, the enumerator 
actually-goes into the field and in the afternoon lists residential 
mailing addresses in her or his assignment area. 

4- On the morning of the third day, enumerators retrrn to the 

classroom to discuss their experiences from the previous day, clear 
up any problems or confusions that resulted, and discuss any 
unusual situations that appear unique to their assignment areas. 
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Following this discussion, the enumerators cover unusual or 
atypical situations that may occur In their field work (In fact 
sonjs reay already have been encountered by enumerators^ and then 
they learn how to fill out payroll and progress report forms 

5. The training on the third day ends with the enumerators taking an 
end-of-course test. In addition to this test, enumerator 
performance f» .^n the preceding afternoon Is evaluated by comparing 
It with the rer-ilts of an advance listing (completed by a different 
enumerator) of t limited number of addresses In their assignment 
areas. Therefore, proficiency at the end of training Is evaluated 
by both a knowledge test and a skill test. The trainer uses the 
results of these evaluations to decide which enumerators need 
additional training (on-the-job) or which should be released 
because they apparently a; 2 unable to do the work. 

5.2 IMPORTANT FEATURES OF THE TRAINING 

This training design has several features worth pointing out First, unlike 
previous census training that covered this material, an Integral part of this 
training requires the enumerator to go out Into the field and apply what she 
J« ^ learning In the classroom. Therefore, when the person returns 
to the classroom on the third day, there H an opportunity to review problems 
misconceptions, or ambiguous procedures that had been covered up to that point 
in the training. Also, there Is the opportunity to discuss local situations 
that may be quite common (e.g., seasonal housing In a resort coimunlty) In 
""^"^ stressed In training designed for the entire 

united States. 

Another Important feature Is that, with the exception of the first day, the 

[? H ^ 0""^ experience has indicated that training 

which extends beyond a half day loses much of Its effectiveness. 

J«*Il^rJ.^!!*"r!: l^^^^JJ^ apparent from the preceding discussion. Is that 
by using the Abbotsvllle simulation, the training Is presented In an 
integrated fashion and the enumerator learns the job by doing It For 
example, using the census map, the enumerator learns to orient the map. to 
anenr.ine his/her location on the map, and to canvass blocks In Abbotsvllle. 

As each structure (possible living quarters) Is encountered, role playing Is 
used to present the class with descriptive Information which Includes both 
mailing address Information, as well as Information about other possible 
living quarters-on the property. However, by design, not all structures 
encountered should be listed. Only the mailing addresses for places where 
people live or could live are Included. 

Initially In the training, these role plays are straightforward, but as the 
training progresses, complexities such as additional housing units or unusual 
living arrangements are Introduced. During each Interview at a housing unit, 
the enumerators enter the mailing address In the address register and spot the 
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location of the unit on the census map. These steps are Identical to what 
they would do while working. Accordingly, they get practice applying census 
definitions, listing the addresses, preparing adequate location descriptions 
which could be used by cnuRserators In later census operations, and using map 
scales to spot the correct location of housing units. As this exercise 
progresses through the first day and a half of training, the trainer can also 
check the work of each enumerator to ensure that they are making correct 
entries and understand the training to that point. 

In addition to encountering different types of housing arrangements and 
troublesome situations, as the enumerators canvass Abbotsville, they also 
encounter more difficult canvassing problems and a variety of geographic 
problems (i.e., inconsistencies between the map and reality). Again, a 
similar strategy is used. The training starts with simple, uncomplicated 
situations and then gradually increases in complexity. The Intent is to make 
the enumerators aware that their maps will not be perfect and that they will 
be expected to make corrections and to update them. 



5.3 EVALUATIOMS OF THE EFFECTIVENESS OF TRAINING 

As noted briefly, the effectiveness of the training was evaluated using two 
approaches: one was a test given at the end of -training, and the other was a 
comparison of some of the addresses listed by an enumerator on the second day 
of training with an "advance" listing done previously by another enumerator. 
The Intent of both of these evaluations was to ensure that enumerators 
possessed a minimum level of knowledge and skills before they were allowed to 
work. Because the data are not yet available, evaluation results from the 
advance listing will not be discussed in this paper. Instead, the focus will 
be on the end-of-course exercise (test) given in class at the conclusion of 
training. 



5.3.1 THE END-OF-COURSE TEST 

Although test-like questions and tests have been used previously in census 
training, there were two unique features about this test. 

1. First, it was designed systematically by a group of content experts 
so that a "passing" score would result which represented the 
minimum knowledge and skills required by a borderline enumerator. 

2. Second, if an enumerator did not achieve a passing score, she or he 
would either be retrained or released. 

The approach used to develop test items and a passing score was a variation of 
Nedelsky's method described in Livingston and Zieky (1982) 2. jhis approach 
requires the following five basic steps: 
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1. Select the experts (Judges). 

2. Define "borderline* knowledge and skills. 

3. Train the judges. 

4. Collect judgments. 

5. Combine the judgments to choose a passing score. 

The JJ-ltem test that resulted Is shown as Attachment B. (Each part of 
question 3 was counted as a separate Item for sroring purposes.) The oasslna 
score for this test was estimated to be ?5 for a borderline test-taker 

5.3.2 TEST RESULTS 

IJL^r^^H]"^ described in this report was used In a test census conducted In 
1987 In Hissourl and Washington. Final review exercises (tests) were 
available for analysis from 143 enumerators who were trained as orellst 
enumerators. 

Table 1 shows the frequency distribution of scores for these enumerators The 

V^tl r«^^«" exercise was 42.3 with a standard deviation 
Of 3.Z9. Our belief Is that, even If our group of experts set the pascing 
score too low. the high average score Indicates that training using the 
garaeboard- approach was very effective In teaching Important procedural 
Knowledge. Attachment C shows the performance of the group on Individual 

°" ^^^^ analysis, one Important skill which n-eds 
additional emphasis In training Is use of the map scale (Item 22). 

Somewhat surprisingly, no enumerator In this sample failed the test We may 
therefore want to consider making the test more difficult by changing the mix 
of Items or purposely creating more difficult Items. We will have to pursue 
this matter further by correlating test scores with field performance to 
determine the empirical validity of the present passing score. At this time 
however. It Is Important to note that the present test was viewed as a fair 
representation of the knowledge and skills necessary to do the prellst 
enumerator's job. 



15 



13 



Table 1 

Frequency Distribution of Enumerator Scores on Final Test 

(N « 143) 



Scorft 


Frequency 


25 


1 


33 


1 


34 


2 


35 


1 


36 


1 


37 


5 


38 


7 


39 


8 


40 


7 


41 


11 


42 


19 


43 


22 


44 


22 


45 


15 


46 


17 


47 


4 



Cumulative 
Percent Percent 



.7 


.7 


.7 


1.4 


1.4 


2.8 


.7 


3.5 


.7 


4.2 


3.5 


7.7 


4.9 


12.6 


5.6 


18.2 


4.9 


23.1 


7.7 


30.8 


13.3 


44.1 


15.4 


59.4 


15.4 


74.8 


10.5 


85.3 


11 .9 


97.2 


2.8 


100.0 



Mean =42.3 Standard Deviation =3.29 



6. REACTIONS FROM OBSERVERS AND FUTURE PLANS 

Reports from people who observed the training Indicated that It achieved Its 
goal of keeping the trainees actively Involved In the learning process. 
Interest level and participation remained high throughout the training 
session. Therefore, as an Instructional device, the basic approach seems 
sound. However, as with any new approach, we have Identified areas of 
potential Improvement. 

The most significant criticism from one test area (East Central Missouri) was 
that the situations simulated on Abbotsville were not realistic enough. 
Consequently, enumerators suffered "map shock" when they started working 
Problems encountered in the field, but not simulated on Abbotsville, Included 
multiple map sheets and Insets for an assignment area (Abbotsville used only 
one map sheet and no insets), blocks which were not numbered consecutively, 
blocks which extended over more than one map sheet, assignment area and block 
boundaries in the Middle of lakes and rivers, highly irregular block shapes, 
and block numbers assigned to unusual geographic features such as highway 
medians or cloverleafs. In addition, a general criticism was that Abbotsville 
was not "rural" enough in its depiction of geographic features. 
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We do not question the validity of these criticisms, but they point out the 
problems we face In attempting to develop standardized map-use training for 
the entire nation. A training designer, faced with a limited training period, 
must decide which training content will be covered and how much emphasis It 
will receive. In addition, assumptions must be made about the mao orodiirte 
and the types of irregularities that may occur. Abbotsvllle was designed, 
based on past experiences, to represent a spectrum of problems, but the test 
census (prel 1st for the dress rehearsal) In East Central Hissourl raised a 
host of others, as will each section of the country. 

Some of the existing problems can be attributed to the development of our 
map-production system (TIGER) and refinements that need to made to It. Still, 
I believe the lesson Is clear that we need to Increase the variety and 
difficulty of geographic situations represented on Abbotsvllle. Therefore, 
the most Important Imnedlate Improvement will be to redesign Abbotsvllle so 
that a greater variety of geographic situations will be represented. In 
addition, we will attempt to better "tailor" the training to local 
differences. This will be accomplished by modifying Abbotsvllle so that three 
separate enumerator assignment areas are created. Instead of the single one 
that currently exists. 

The first of these assignment areas will reflect a combination of urban and 
rural geographic features and living arrangements and all persons being 
trained as prellst enumerators will receive this training. A second 
assignment area will be rural In nature, and the third will be primarily urban. 

Accordingly, enumerators who will be working In primarily rural areas will be 
trained on the "combination" assignment area and then given supplemental 
(tailored) training on the rural assignment area. Similarly, enumerators who 
will be working In primarily urban areas will be trained on the "combination" 
assignment area and then given supplemental training on the urban assignment 
area. In addition, supplemental instructions (for example, handouts) will be 
used in areas with large numbers of seasonal housing units or other unusual 
characteristics. These instructions will be used on an "as needed" basis 
since only small areas of the country are affected. 

Other plans we are pursuing involve the use of the gameboard simulation 
approach in current, ongoing survey work. Specifically, we plan to conduct a 
formal evaluation which compares use of the gameboard with our standard, 
traditional approach for training interviewers to list addresses. 
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ATTACHMENT B 



REVIEW EXERCISE 



instructions:. Pick the best answer to each of the foilowinq 

questions. Enter your answers on the acco.npanvina 
answer sheet oy circling the correct choice!^ ^ ^ 

You will have 45 minutes to complete this 
exercise. You may use your olue pages.' 

1. How does the Census Bureau define a housing unit? 

^* o^^c?Ho '^^''t (separate entrance from the 

outside or from a common hallway) 

D. People living there must live and eat separately from 
otners 

c. The place must be occupied - people must live there 
o • a & D 
e. a, o & c 

2. Why IS the Census Bureau developing a list of mailing 
aaaresses? ^ 

a. To evaluate the effectiveness of the 1980 census 

b. so census questionnaires carr' be mailed or dropped off at 
those addresses 

c. To sell to other government agencies for surveys they do 

d. None of the above ' 



3. Indicate by circling "yes" or "no" which of the following 
types of places would be listed in your address register 
(include ooth housing units and special places): 



a. 
b. 
c. 
d. 
e. 
f . 

g. 

h. 

1 . 
j. 

k. 
1. 
m. 
n. 
o. 
p. 

q. 

r. 



An occupied mobile home or trailer 
A vacant mobile hoane or trailer 

cement pad for a trailer in a trailer park 
vacant house 

building used to store tools & equipment 
church 

public elementary school 

business like a hardware store or dress shop 
cabin used only during hunting season 
motsl 
hospital 
prison 
A -campground 

A day school for children whose parents work 
A boarding school 

A house under construction with final doors 

and windows in place 

Cabins for seasonal migrant workers 

A vacant house with a condemned sign 



A 
A 
A 
A 
A 
A 
A 
A 
A 
A 



yes 


no 


yes 


no 


yes 


no 


yes 


no 


yes 


no 


yes 


no 


yes 


no 


yes 


no 


yes 


no 


yes 


no 


yes 


no 


yes 


no 


yes 


no 


yes 


no 


yes 


no 


yes 


no 


yes 


no 


yes 


no 



ERIC 



3 

20 



DX-635.2 



Figure 1 



la - Assignment Area 



lb <^ Census Map 



LAKEViEW 



no 



-5^ 




II) 





\12 


i 




t 






lis 


Hi 


MHtm 



Census Map 



lU 



^ *® "^•'^ *® ^^5"" 1 This iUustraMon shows 

part of your assignment area and the corresponding census map. 

4. If you were traveling south on Hoyt St. between Horseshoe 
Drive and Lakeview Rd, which block would be on your right? 

a. 112 

b. 115 _ 

c. 116 

d. 117 



5. 



If you started canvassing block 115 at the corner of Miller 

fj"? "•"'^y Street, which addresses would be listed in 

block 1157 

a. 24 & 26 Henry Street 

b. 22, 24 & 26 Henry Street 

c. 22, 23, 24, 25 ft 26 Henry Striet 

d. 22, 24 ft 26 Henry Street and 18 and 20 Miller Street 
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6. After you findsn canvassing block II5, which olock ^ould vou 
canvass next? wau^-r. .*ouia you 

a. il2 

b. 114 

c. 116 

d. 117 

^* J!;at'SJu!d°J.u°Ho '^^^^ ^ name, 

wnat wouid you do on your census map? 

a. Cross it out 

o. Give It a name 

c. Call It "UN RD A" (for unnamed road A) 

d. Draw a circle around it 



8. If you canvass block 112 correctly, you will travel 

on Henry Street and on Lakeview. 

a. North, East 

b. South, East 

c. North, West 

d. .South, West 

9. If the portion o£ Hoyt Street in block 115 between Horseshoe 
Prive and Miller street did not have any living quarters on 
It, what entry would you make on your census map? 

a. Nothing, leave it blank 

b. Print "No lq" for "No Living Quarters" 

c. Put a box around the block number 

d. Enter a map spot with a zero 

le. If there were no living quarters in an entire block, what 
would you do? 

a. Cross out the block on the census map 

b. Draw a box around the block ni-mber on the census map 

c. Print_the bloQk number, on a 7,ine of the listing paae 
with th« •ntry '♦No LQ" 

d. Do nothing • Ittave as is 

11. Notice that Lakeview Ct. exists in the assignment area but 
18 not shown on your census map. What would you do? 

a. Add^ the road to the map 

b. Map spot the living quarters on Lakeview Ct. 

c. Both a & b 
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12. 




a. Draw the alley on your map and label it "UN rd a " 
If it IS the first unnamed road in that block ' 

b. Nothing - leave the map as is 

c. Draw the alley on the map, but do not name it 

d. None of the above 

13. A map spot on a census map refers to: 



location of the mailbox where mail is delivered for 



b. 
c. 
d. 



The location of the living quarters 
only multiunit (apartment) buildings 
None of the above 
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CENSUS MAP 



Cansus Map 




14. In th« illustration abov«, the enumerator, while canvassing 
block 207, discovers that the bridge on Lake Rd crossing 
Bob's Creek is out and will not be repaired for at least a 
month. Several summer cabins are clearly visible on the 
other side of the creek. The enumerator should: 

a. Return in a month 

b. '*x** out Lake Rd on the other side of the creek because 
it is impassable 

c. Map spot and enter a location description for each cabin 
the enumerator sees 

d. Map spot and list the cabins on the other side of the 
creek as a cluster 

15. You are listing in your ARA when you come to an apartment 
building. The front door is locked, and there are no 
tenants around to let you in. What must you do? 

a. List the building as a cluster 

b. Pill a refusal record 

c. List the building as a special place 

d. Try to contact the building manager, owner, or real 
estate representative so you can get in the building 
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Questions 16 to 19 refer to the illustration on page^. ^ 

16. Which of the map spot numbers in block loi refer to a special place 

a. 1 ' 

b. 2 

c. 3 

d. 4 

17. What entry did tne enumerator forget to make for map spot 
numbers 2 and 4 in clock 101? 

a. Forgot to print out the name of tne city and state 

b. Left out the zip cods 

c. The abbreviation "TRLR" is missing in column (5) 

d. Tne pnysical location description in column (9) is confusing 

18. How would you list a townhouse complex of 25 townhouses? 

a. List each townhouse on a separate line of tne listing page 

b. List tne townhouse complex as a 10+ ouilding 

c. Cneck the special place pages to see if the townhouse 
complex IS listed there 

d. List the townhouse complex as a special place 

19. A location description must be entered in column (9) whenever: 

a. You will have to return to the living quarters and don't 
think you could find it without directions 

b. The living quarters is difficult to locate 

c. The living quarters has a house number and street name address 

d. The mailing address i? either a Post office (P.O.) box or 
Rural Route (RR) 

20. What, if anything, is wrong with the location description 
for map spot number 4 in block 101? 

a. The abbreviation for green (GR) is wrong 

b. Samuel should be Sam 

c. It is too long 

d. Everything is, fine. 

21. You artt canvassing when you come to four trailers set back 
from the coad. A sign in front says TOM'S TRAILER PARK. 
The trailers are too close together to map spot 
individually. What should you do? 

a. Li»t them as a cluster 

b. List each trailer separately and assign a range of 
numbers to one nap spot 

c. List TOMS TRAILER PAi^K as a special place 

d. None of the above 
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Questions 21 to 28 refer to the illustration of an ARA above. 

22. The distance along Church St., from valley Drive to the 
unnamed road that leads to the golf course, is about: 

a. 1 and 1/2 miles 

b. 2 miles 

c. 2 and 1/2 miles 

d. 3 miles 

23. An asterisk (*) is used on a census map when: 

a. The block has apecial places within it 

b. The block is an unusual block with many problem that y 
need to be aware 

c. The block number is print^ed more than once 

d. The block is big 

24. A street extension is part of the boundary between blocks: 

a. 105 and 106 

b. 105 and 113 

c. 110 and 111 

d. 107 and ill 
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25. Are there any ^living quarters in this ARA south of Rt 235? 

a. yes 

b, no 

26. If While canvassing bloc) 108 you discover tnat 1st Street 
does not exist, what would you do? 

a. Correct the map by X'lng it out 

b. Do notning • leave tne map as is 

c. Tell my crew leader 

d. None of the above 

27. If 1st Street does not exist, where would you list tne 
addresses of living quarters in blocks 108 and 109? 

a. I would list them under block 108 

b. I would list them under block 109 

c. I would list them in the blocks shown on the census map 

d. I would create a block, called UN BLK A and list them in 
that 

28. Assume the enumerator finished canvassing block 105, how 
many^living quarters (including special places and housing 
units) did the enumerator find? 

a. 10 

b. 18 

c. 30 

d. 46 

29. If tne enumerator finished canvassing block 105, what did the 
enumerator forget to do? 

a. Forgot to start with the number 1 for the first map spot 
in the block 

b. Forgot to circle the block number when canvassing was 
completed 

c. Forgot to canvass in a clockwise direction 

d. None of the above 

30. What are some ways to determine the location of an invisiole 
boundary on your census map? 

a. Use your car odometer to estimate the distance from a 
visible feature on the map, for example, an intersection 
or a river 

b. Look for signs on the road 

c. Ask residents where the line is 

d. All of the above 
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Btcraerator l>erfonnanoe On Individual Itest Itans 

(Note: Ihe cxsrrect ansMer is marked by an asterisk. 

Alaor proporticjns do not sum to 1.0 for all ita« 
due to rounding errors. ) 



a* 


no 


b. .02 c. 


• 01 


♦d^ •S? 


o* 


.UJ. 


*b. .78 c. 


• 01 


Om •IS 


dm 






0.99 


no 


A A 
0^0 


w 

o* 




*yes 


1.0 




A A 
0^0 






•yes 


0.87 


IX/ 




d. 




*ye« 


0.99 


no 


0.01 


e. 




yes 


0.01 


*i» 


0.99 


f. 




yes 


0.02 


♦no 


0.98 


g. 




yes 


0.03 


♦no 


0.97 


h. 




yes 


0.03 


♦no 


0.97 


i. 




*yes 


0.80 


no 


0.20 


j' 




*ye« 


0.97 


no 


0.03 


k. 




*yes 


0.89 


no 


0.11 


1. 




*yes 


0.94 


no 


0.06 


m. 




•yes 


0.74 


no 


0.26 


n. 




yes 


0.06 


♦no 


0.94 


o. 




•yes 


0.78 


no 


0.22 


P- 




•yes 


0.98 


no 


0.02 


q- 




•yes 


0.97 


no 


0.03 


r. 




yes 


0.02 


♦no 


0.97 



4. 


•a. .90 


b. 


.01 


c. .10 


d. 


.00 


5. 


a. 


.01 


b. 


.26 


c. .01 


*d. 


.72 


6. 


a. 


.03 


b. 


.04 


•c. .92 


d. 


.01 


7. 


a. 


.04 


b. 


.02 


•c. .94 


d. 


.00 


8. 


•a. 


.93 


b. 


.03 


c. .03 


d. 


.02 


9. 


a. 


.01 


*b. 


.98 


c. .01 


d. 


.00 


10. 


a. 


*B0 


b. 


.03 


*c. .97 


d. 


.00 


U. 


a. 


.05 


b. 


.00 


•c. .95 






12. 


a. 


.27 


•b. 


.65 


c. .02 


d. 


.06 


13. 


a. 


.01 


*b. 


.99 


c. .00 


d. 


.00 


14. a. 


.01 


b. 


.01 


c. .13 


•d. 


.86 
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15. 


a. 03 




in 


c 






oc: 
» .09 


1 c 
lo« 


*m 1 ft 


D. 


Aft 

.00 


C. 


AA 

.00 


u. 


AA 

.00 




a* •uu 


D. 


.01 


*c. 


.96 


d. 


A A 

.04 






D. 


.20 


c. 


AO 

.02 


d. 


.02 




a. .04 


b. 


.03 


c. 


.00 


♦d. 


.94 


Oft 


m ftl 


c. 


AA 

.00 


»c. 


.80 


d. 


.17 


21. 


a. .01 


•b. 


.94 


c. 


.03 


d. 


• 02 


22. 


a. 41 


♦b. 


CO 


c. 


Al 

.01 


d. 


.01 


23. 


a. .00 


b. 


m 






a. 


AA 
.00 


24. *a. .86 


b. 


.Oo 


c. 


no 

.00 


a. 


ft! 
.01 


25. 


yes .05 






74 






26. 


♦a. .99 


b. 


Aft 

.00 


c. 


Al 

.01 


d. 


.01 


27. 


a. .03 


b. 


.02 


*c. 


.87 


d. 


.08 


28. 


a. .02 


*b. 


.98 


c. 


.00 


d. 


.00 


29. 


a. .01 


♦b. 


.97 


c. 


.01 


d. 


02 


30. 


a. .09 


b. 


.01 


c. 


.01 


*d. 


.90 
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